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[57] ABSTRACT 

In a system for processing and imaging documents to 
develop a stream of digital, video bit sets, each related to a 
different document is a passing array, this system including 
an arrangement for simultaneously compressing a number of 
said bit-sets for different document images and sending the 
results to output, this arrangement as comprising: 

a preprocessing stage far distributing each said bit set in 
a pair, of like parallel bit-compression paths, one. a 
Master path for half the bits in a set the other a Slave 
path for the other half as controlled by The Master, with 
both input to a common buffer, each compression path 
being adapted to execute a first compression and then 
a conditional second compression when certain initial 
factors are indicated and to provide a real-time- 
compressed output to this buffer; and 
both said compressions being performed on a single, two 
pass stage of a Histogram/Compressor printed circuit 
board. 

3 Claims, 9 Drawing Sheets 
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DOCUMENT PROCESSING DETAILED DESCRIPTION 
RELATED APPLICATION System Overview 
A related application. U.S. Ser. No. 123.531, was filed FIG. 1A will be understood to depict part of a Financial 
Sqx 17^ 1993 issued as U.S. Pat No. 5,420.941 on May 30. 5 item Sorting System If having a typical Item Sorter (e.g.. in 
1996, by inventors in common herewith; it was a Continu- the preferred embodiment of this invention, a Model DP 
ation of Ser. No. 931,654. filed Aug. 17, 1992 and now igOO sorter which is manufactured by the Unisys Corpora- 
abandoned, which, in turn, was a Continuation of Ser. No. tion of Blue Bell Pa.) 

419528. filed Oct 10. 1989 andnow abandoned. The instant i<* ~ /• ~ . , _ _ - . , 

MrA ie „ nMimttnt: ^ ^ M ^ ^ * ,. J in Sorter 12 contains a Track for transport of checks or like 

case is a Continuation-in-part of these applications and «?: T . _ A . . ^ _ . , , 

. . _ . . *T . , .^Tf _T , Finanaal Items to be processed, e.g.. by a typical reader and 

owned in common, and here claims priority therefrom under „ . , . ... . . !. 4 . „ . . " 

the U S Patent laws. related controller. Additionally, the Sorter contains a Camera 

Assembly, and an Image Processor 24 apt for use in accor- 

FIELD OF THE INVENTION dance with the teachings of the preferred embodiment of this 



15 



invention. 



JretS^^ ContTOl]er 20 '* C0U P led t0 ** R€adcr ™ d t0 * Host 

m^on r e r^f y * W Computer 28, as well as to Image Processor 24, as known in 

the art. An Image Storage Module 34 is also coupled to the 
BACKGROUND OF THE INVENTION Image Processor 24 and to a plurality of Workstations ws. 

20 The Camera Assembly is coupled to the Image Processor 24. 

Workers h i the art of automatically processing documents u checks or like Items sequentially pass the 

realize that it is often important to extract data therefrom Reader which can read a typical magnetic code thereon. The 
e.g.. as digital unage bits) and create a stream of represen- ^ ^ out u mcn ^ to Computer 28, for storage 
Utional signals to be ttien processed and transformed. This therdD ^ to UoBge Processor 24. As each Kern travels 
is the object of the following. 23 along the Track, it passes the Camera System which captures 

At times such a stream of image bits should be pre- an image thereof and outputs a digital representation of the 
processed preparatory to compression thereof. A related image to the Image Processor 24. This digital representation 
object hereof is to preprocess such signals in aid of their comprises a plurality of image pixels having an intensity 
better compression. A related object is to do so for imaging which can be represented by an "intensity-number" between 
data which is presented in a multi-bit data stream, for 30 0 and 255. Image Processor 24 then processes this digitized 
compressing and reducing the bits, and sending the results to image and sends the associated signals to the Image Storage 
utilization means, preferably in an arrangement which com- Module 34 for storage therein. After this, the documents are 
prises a preprocessing (buffer) stage for presenting the data then sorted and stored in the usual way. 
stream .In two paralld bit-streams, plus a coimy*sion stage After a typical block of checks has been processed in this 
providing two parallel^ compression paths for the in/out 35 manner, an operator at one of the Workstations may request 
streams via a prescribed first compression-processing and mc aforementioned image bits torn Storage Mc4ule34. 
then via a prescribed second ccanpresaon-processing to These bits are then downloaded to his Workstation along 
provide a prescribed t^e^ornpressed output to the utiliza- with their associated identifying codc 
Uon means. A related object is to execute such compression obtamed from Host Computer 28 
in "real tune", and according to JPEG standards. Still 40 AX ^ L . , . 

another object is to execute such compression by more . mcsc blt scts of O^S*) « capped by a 

efficient faster means. Workstation, an operator may electronically enter associated 

data (eg., check dollar-amount) with a given documcnt- 
BRIEF DESCRIPTION OF THE DRAWINGS i^age and electronically resolve any difficulties; (e^.. an 

e _ , JC error in reading the magnetic code thereon) entering and 

^™;; Ct f unda^gof mepresentinven- 45 ^ ^ ^^SL for ^ [J^Sta* 

^^oiTl ^Tl , ^ • ^ maybenude ^ and its associated data and cannons then form a 

U^e following detaded description, taken in conjunction singlc completed electronic computerized record 

wrth the accompanying drawings in which: which can then be^eTtoStoragc Moduli. Thereafter, it 

FIG. 1A is a very general block diagram of part of a may be accessed for use in automatically inscribing associ- 
document sorter system, while FIG. 1 is a block diagram of 30 ated data (e.g.. dollar amount, corrections) upon the stored 

a document imaging module embodiment for such a system. Items. In this way. item Sorting System 10 substantially 

made in accordance with the teachings of this invention; eliminates the manual handling of Hems 16 when an asso- 

FIG. 2 Is a diagrammatic representation of preprocessing/ elated dollar amount Is placed thereon, thereby increasing 

compression steps for sample item images with a module as the efficiency and timeliness of sorting and processing, 
in FIG. 1. whOe FIG. 3 is a like diagram of a related array; 

while FIG. 3 is a block diagram of a related array and FIG. Compression Stages 

SS^ftSSa" 1 HiStogram/COmPrCS50r ™* ^ c » b P<accd one of »n" JPEG 

„ . . „ t proce ssing/compr e ssion Stages according to a feature 

FIG. 4 is a diagram of eight related processing paths; ^ hereof. Two of these JPEG processing/compression paths 

FIG. 5 is an item-related diagram of a subdivided Input are preferably implemented on a Histogram/Compression 

Buffer for the array in FIG. 3. while FIGS. 6 (6A-4SD) printed circuit board assembly (PCBA) as shown in FIG. 1C. 
rodicate how the item in FIG. 5 is preferably addressed and image Processor 24 of FIG. 1A is preferably characterized 

processed; and by ^ following; ^ image Digitizer Unit (D of FIG. 2) for 

FIG. 7 similarly illustrates how the top/bottom of the item 65 analog to digital conversion of the captured image, a 

are detected for such processing in two four-channel Normalizer/Scaler (N/S Unit FIG. 2) for normalization and 

streams, scaling of the video image, a set of "n*\ parallel JPEG 
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ftocessing/Comprcssion Units ( Jl etc. of FIG. 2 and 24-A of 
FIG. 1A) for image processing/JPEG compression and a 
JPEG Compressed Data Buffer Unit (JCDB in FIG. 2) far 
collection and temporary storage of compressed images 
from the JPEG Processtog/Compression Units. [Note 
"JPEG** refers to the compression standard by the "Joint 
Photographic Experts Group**.] 

These functions are implemented especially to meet the 
performance requirements of a high speed check process 
(imaging) system and to minimi 7* the cost of the system by 
reducing the amount of "parallel hardware** needed to com- 
press images. A preferred "dual** Processing/Compression 
Stage (for JPEG) is indicated in FIG. 1C. 

The JPEG compression hardware performs image pro- 
cessing on a 128 grey level, scaled image before executing 
a two-pass JPEG compression. Scaling is nominally at 137.5 
dpi but can range from 1373 dpi to SO dpi in steps of 123 
dpi. This two-pass compression is designed — according to 
this feature — to reduce images to a predictable "packet size** 
apt for use in the entire High-Speed Check Imaging System, 
These functions of the JPEG "P/C" (Processing/ 
Compression) hardware, (detailed below) must be 
performed, here, in real time on check images as they move 
down a high-speed Check Sorter Track at an approximate 
rate of 1800 checks per minute. 

It is not possible, within the environment of the high- 
speed Check Imaging System (detailed below), for a single 
JPEG "P/CT (Frocessmg/Compression) path to process 
every check in real time. Therefore, multiple JPEG "P/C 
paths, operating in parallel, are needed (eg., see FIG. 1-C). 
To reduce the time required for each processing/ 
compression path to operate on an image (and therefore 
reduce the number of parallel paths needed to maintain 
system performance), many of the required functions of the 
JPEG "P/C* path have been implemented in hardware. The 
detailed explanation of each of these functions is described 
below. 

System Environment 

A JPEG **P/C (Process/Compression) path as here 
contemplated, will perform image processing and real time 
JPEG compression of normalized and scaled images of 
documents (e.g. checks) captured in a Check Sorter at an 
average rate of 1800 checks per minute. The diagram in FIG. 
2 indicates conditions under which each JPEG "P/C** path 
preferably operates and the performance required of such a 
unit to maintain overall system performance. 

FIG. 2 shows the processing of a sample of check images 
as they move left to right across the page, simulating the way 
a check would move through a Check Sorter. (Here, track 
speed of sorter assumed to be 300 inches per second; this 
means that a check 6 inches long will take 20 ms to pass a 
fixed point on the Sorter Track.) Here, checks can range in 
length from 5.75 inches to 9 inches (19 ms to 30 ms). with 
inter-checks-gaps ranging from 1-5 inches (5 ms) to several 
inches. 

The check images are captured by camera means, here 
preferably comprised of a vertical. 1024-element CCD array 
which samples 256 grey levels per pixel (8 bits) with a 
resolution of 200 pixels per inch. In the vertical direction, 
the Camera can capture images up to 5.12 inches high. The 
1024 element array takes a snapshot of the check every 
16.66 us as it moves down the Sorter Track, yielding a 
horizontal capture resolution of 200 pixels per inch. These 
1024 pixel scans (captured every 16.66 us by the CCD array) 
axe divided into eight 128 pixel Channels (shown as CH O 



4 

through CH 7 in FIG. 2. each composed of 128 pixel scans). 
Hardware in the Digitizer D converts each 128 pixel scan 
into eight serial streams of pixels, with one pixel being 
output approximately every 130 ns. 

5 The NTS (Normalizer/Scaler) hardware next normalizes 
the pixel values from the 1024 CCD elements and then 
scales the image down. The maximum resolution after 
scaling is 137.5 ( J Vieths scaling of 200 dpi captured image) 
pixels per inch in both dimensions (e.g.. see example shown 

10 in FIG. 2). In this example the 128 pixel scans in each 
Channel are reduced to 88 pixels per scan. The N/S hardware 
"time-multiplexes" four channels* worth of data onto two. 
8-bit serial outputs to the JPEG "P/C hardware. The 88 
pixels from all four "even numbered** (total of 352 pixels per 

15 scan at 137.5 dpi) Channels (0. 2, 4, 6) are tune-multiplexed 
along one serial stream, while the pixels from the four "odd" 
Channels (1. 3. 5 and 7) are multiplexed along a second 
serial stream. The two serial pixel streams operate at 50 
ns/pixel (20 MHz) to guarantee that all 352 pixels per scan 

20 on each serial path can be transferred to the JPEG M P/C* 
hardware before the next scan is transferred. 

A pair of JPEG "P/C* paths are preferably implemented 
on an H/C PCB (Histograrn/Compressor Printed Circuit 
Board, as indicated in FIG. 1C). This H/C PCB must detect 

25 the image dimensions and perform image processing on the 
scaled image prior to compression. Selected image process- 
ing algorithms require a grey level histogram of the entire 
image prior to execution. This means the entire image must 
be buffered (eg., at 3-1, FIG. 3) and a histogram generated 

30 (e.g.. at 5-7) before image processing can begin. Once image 
processing is complete, compression can begin. 

The performance of the entire image system is what 
dictates how the JPEG Processmg/Corapression hardware 

35 will reduce each image to a target packet size; this is why the 
here-detailed JPEG Compression hardware embodiment 
executes a 2-pass compression. The first pass uses a "stan- 
dard** QM (Quantization Matrix) for JPEG compression. 
The results of the first pass compression, as well as the 

w detected image dimensions, are used to pick a second QM 
for a second, final compression that will reduce the scaled 
image to the desired compressed packet size. 

To maintain system performance, the JPEG Processing/ 
Compression hardware must perform all these functions in 

45 real time which equates to generating a JPEG compression 
packet in 20 ms for a 6-inch check. Because a single JPEG 
"P/C** path cannot meet these requirements, multiple paths 
operating in parallel are required. The described H/C PCB 
was equipped with two independent JPEG *T/C* paths for 

50 this purpose (see FIGS. 3. 1C; preferably, the system has 
locations for up to 4 H/C PCBs. for Ront/Rear imaging, this 
means the system can have as many as 8 JPEG compression 
paths operating in parallel; e.g.. two for each H/C PCB— Le.. 
a pair on each side). For example. FIG. 4 indicates how two 

55 JPEG processing/compression paths are implemented on 
one H/C PCBAand how up to 4 H/Cs can be used on each 
side (front and back) of the imaging system. 

Image Module. TM; FIG. 1 

60 The JPEG Image Module QM) is a device mat in con- 
junction with a document processor allows image data from 
the front and rear of documents to be collected, compressed, 
packaged and (finally) transmitted to a mass storage device. 
The document processor is a device which is capable of 

65 transporting documents down a track, reading data encoded 
on the documents and providing that data to an application 
program running on a host computer and (finally) sorting 
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documents to bins based upon that information. The IM synchronously the same image and compare compression 

provides outputs to alternative recognition devices such as a result to detect failures. The sequencing of image data into. 

Courtesy Amount Reader (CAR) unit (1-23, FIG. 1) and and compressed data from, the H/Cs is controlled by a state 

mass storage devices such as a Storage Retrieval Module machine in the JPEG Compressed Data Buffer (JCDB) 1-15. 

(SRM: 1-20. FIG. 1). Images can be retrieved from the SRM 5 When a HCs path's compression is complete it signals the 

for data entry, or data correction. The new. augmented or JCDB. When the JCDB is ready to accept data from that 

corrected data is then passed on to the application main- path, it signals that path to output data for storage on the 

frame. Data read by the CAR unit is also returned to the JCDB. A signal PDOCPRES_N which is activated when the 

application mainframe. In this way the document data base N/S detects that a document is in front of the camera is 

can be more economically updated and corrected for use by 10 applied from the N/S units to JCDB 1-15, whose state 

the application program, machine uses it to sequentially allocate images to H/C paths. 

FIG. 1 is a block diagram of major functional portions of Buffer JCDB 1-15 is coupled to a Main Processor (MP) 

such an imaging module IM, apt for use with this invention. 1-16 which packages the JPEG compressed image data into 

Preferably, module IM is used, as a printed circuit unit the TIFF format employed by the system, 

(board) for imaging/processing of images from one side of 15 

passing documents, with a second, like board (not shown) Further on Module IM. FIG. 1 

used for the other (Rear) side. The compressed data is transferred from the MP 1-1 to the 

Module IM produces compressed 8-bit gray level Point-to-point Optical Link (POL board 1-1S> which is a A 

(electronic) images (image data) at resolutions of about 100 fiber-optic interface) for transmission to the Storage and I 

pixels per inch. Image data is compressed using a "JPEG 20 Retrieval Module (SRM) 1-20. The SRM stores the images | 

Baseline Sequential technique, JPEG is a family of gray and. under the direction of the application mainframe. 1 

scale image compression techniques adopted by the Inter- manages the TIFF packaged compressed image files for later 

national Standards Organization (ISO) Joint Photographic distribution to image workstations (not shown) for viewing. 

Expert Group (JPEG) subcommittee, as workers realize. The correction or entry of associated document data, 

compressed images are encapsulated in a Tagged Image File 25 The Diagnostic Transport Interface (DTI) 1-17 is one end 

Format format (TIFF). TIFF is an industry standard format 0 f the interface between the document processor and imag- 

for the encapsulation of image data, as workers realize. mg module jm. The Image Interface Board (HB) MS 

F resides in the document processor and sends document data 

and control signals from the document processor to the DTI 

In FIG. 1. it will be evident that an electronic camera Unit Tb* receives this data and passes document data, across 

1-1 captures successive images (e.g.. of passing checks or me Main Bus. to MP 1-16 for inclusion in the TTFF packet 

like financial documents, front and rear, suitably Dlumi- f° r the associated compressed image. The DTI also receives 

nated; c.g.. lamp illumination controlled by Unit 1-3). The control signals from the document processor's tracking logic 

camera uses a segmented linear '^Charge Coupled Photo 33 through the TJB 1-18 that indicate that a document is 

Diode" (CCPD) array ("segmented" meaning that the linear approaching the camera. These signals are passed on to N/S 

array of photo-diodes is subdivided into 8 segments or boards 1-7. 1-9 where they are used to prime the edge 

channels, each of which has its own output, thus effectively detection circuits to detect the leading and trailing edges of 

multiplying by the number of subdivisions the rate at which documents passing the camera (along the track), 

image data can be clocked- out — here the channels are 40 The Character Recognition (CAR) subsystem 1-21.1-22 

numbered 0 through 7). The electronic image from each and 1-23 subsystem consists of two circuit boards: (see CAR 

channel is digitized by an Image Digitizer 1-5 and presented. Preprocessor or Bypass 1-22. CAR Port 1-21 and the CAR 

in parallel, to a pair of like Normalizcr/Scaler (N/S) units: a Unit 1-23). Here, only the Front N/S boards are linked to 

master N/S 1-7 and a slave N/S 1-9 (eg., on separate boards. CAR subsystem. Both boards perform specialized image 

each for identically processing four video data channels — 45 processing functions on the normalized image data from the 

eg., four "even" numbered channels on Master, four odd on N/S boards, they improve the chances that the Character 

Slave). These channels are merged into a single output Recognition Unit (CAR Unit) 1-23 will successfully read 

channel for compression (as further detailed below). Their information from the document After these processing steps 

output the scaled-normalized image signal path, is indicated the processed image data is sent to the CAR unit for 

in FIG. 1. The transfers of data between the Digitizer, N/S, 50 recognition of data. The results of reading the data are 

and other functions are more diagrammatically illustrated in returned to the document processor for inclusion in the data 

FIG. 2. while processing/cornpression is further, similarly files stored on the application software mainframe. The 

illustrated in FIG. 3. An additional output of normalized information read successfully from the documents can be 

(unsealed) image data comes from each N/S board to used to correct the data files on the mainframe, 

provide image data to a CAR system 1-22. 1-21, 1-23. The 35 

output of the two N/S boards is presented to a Histogram/ Ima 8 e Dat * Synchronization 

Compressor (HQ array preferably comprising from two to Module IM (FIG. 1) can be processing, compressing or 

four like units (boards) 1-11A. 1-11B. 1-11C and 1-11D storing images and be documenting data for as many as 25 

operating in parallel The number of boards depends on images at any one time. It is important to ttm*^ sure that the 

required throughput (in documents per second) as deter- 60 document's images and associated document data from the 

mined by the document processors throughput and the type document processor remain in synchronization so docu- 

of error detection required. Bach unit 1-11 processes and meats are not misidentified 

compresses image data from N/S units 1-7, 1-9 and impte- As documents begin to move down the track of the 

ments two like independent data paths, each of which can document processor each document is detected by tracking 

process an entire single image, w logic (scc Miyw) and assign^ a tracking identification code 

The two paths on the H/C board can independently ("sync tag"). The sync tags are assigned sequentially to each 

process and compress separate images or can compress image (eg., by Software in DTI) to identify it and prevent 
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its loss, as well as help later in sorting. It preferably is 
triggered on detection of a check (document) leading edge 
and comprises a 16-bit identifier code (for image, -frame 
etc) assigned in FIFO order; preferably supplied by the DTI 
unit 

Operation of the document processor is such mat there are 
multiple documents moving through the track at any one 
time. The document processor tracking logic is used to 
determine the physical location of a document in the track. 
The document processor also has subsystems, such as Mag- 
netic Ink Character Recognition (MICR). readers that may 
generate data that is subsequently associated with the docu- 
ment moving through that subsystem. Module IM receives 
the sync tags and document data and queues them up in the 
memory of Main Processor (MP) 1-16. in a first in first out 
(FIFO) fashion; likewise the sync tags are stored in a FIFO 
queue on the NS. When a document moving down the track 
approaches IM camera 1-1. the tracking logic senses it and 
a signal is sent to the TM to alert the NS to find the leading 
edge of the document When the document is found it 
activates the PDOCPRES_JN signal, thus alerting the H/C 
units to the forthcoming image data. When the trailing edge 
of the document is detected by the tracking logic it sends a 
signal to module TM to alert the NS to find this trailing edge. 
When the trailing edge is found, the document's sync tag 
(see FIG. 3A) is pulled from the queue in the N/S and 
attached to the "document status field" (which is appended 
to the trailing end of the related image data). 

The foregoing may be understood as applying to imaging 
of one side (e.g.. Front) of a passing document. Processing 
image data for the other side (e.g.. rear of a document) 
proceeds in a similar manner — preferably with a separate 
independent camera, digitizer. NS. HC. and JCDB boards. 

The sync tags are used in module IM in the following 
ways to assure that image data from a given document are 
kept "in sync" (Le.< in sequence, same for any given 
document): 

1 — When the NS finishes processing an item* the Diag- 
nostic Transport Interface (DTI) checks to make sure 
that the sync tags from both the front and rear master 
NS are the expected "next tags'* (in sequence) and that 
they are identical. 

2 — The H/Cs use the sync tags to assure that the image 
data from the master and slave NS units are identical, 
assuring that these boards are 'In synchronization" 
(ie.. handling data from same document). The HCs 
compress the image, then the sync tags are passed along 
with the compressed-image-data to the JCDBs. where 
they are queued- up (in FIFO fashion). 

3 — The JCDB interrupts the MP when it has image data 
available. The MP reads the image data and status bits 
(which include the sync tag) from the JCDB. and 
checks to see that the sync tag from the image read 
from the JCDB matches the expected sync tag as stored 
in its own memory queue. 

4— The sync tag is also fed to the "CAR PREPROCES- 
SOR OR BYPASS" 1-22 and Carport board 1-21 to 
keep the CAR unit synchronized with document pro- 
cessor flow. 

Whenever a mismatch of sync tags is found, an error is 
declared and document processor flow is ordered to stop. 

••Stop Flow" Requests 

According to a feature hereof, a **Stop Flow Request** 
(SFR) is generated by DTL JCDB. N/S, H/C or ID when 
they detect an "error condition**: e.g.. sync tag mismatch, or 



8 

incorrectly matching document data with image data, or 
detection of conditions that would corrupt or render an 
image unusable. The JCDB detects such an SFR signal and 
interrupts the MP (e.g.. before check processing is carried 

5 further); e.g.. JCDB detects the SFR and latches the source 
thereof in a Stop Flow Accumulator (contained on the 
JCDB) for interrogation by the MP. Use of such Stop Flow 
Requests will reduce the number of documents, time, and 
complexity that would later be involved in "error recovery**. 

10 An example is as follows : a 'leading edge not found** fault 
might be detected at NS unit (signal from the tracking logic 
received, alerting the TM to arrival of a document but the 
edge of the document cannot be determined from the image 
data). As a result, the N/S unit would issue a SFR to 

15 processor MP through the JCDB. terminating further pro- 
cessing of all images from this document — as well as of 
other items upstream of this item in the document proces- 
sor's track. The MP first notifies the document processor to 
stop the flow of documents, and then finishes handling the 

20 image data it has confidence in (e.g.. compressed images 
downstream of the point of fault detection). The mishandled 
document and any documents that followed it through the 
transport will have to be recovered from the document 
processor's pockets and repassed through the document 

25 processor on resumption of processing. This system may be 
set up for various Stop Flow requirements (according to the 
application involved) and to automatically, programmati- 
cally "mask" certain faults accordingly. For example some 
application could require a SFR if the trailing edge of a 

30 document is not found, yet other applications could be more 
forgiving and not require a SFR for this situation. 

The advantage of this Stop How feature is that it reduces 
the number of documents mat have to be repassed through 
the document processor when a SFR occurs — because the 

35 processor is notified immediately when an error condition 
generates a stop flow request, and because it is associated 
with a particular item or event; thus antecedent documents 
(conditions) can be handled normally, thus reducing the 
number of documents that must be specially handled to 

40 recover from an SFR event 

Monitor Camera. FIG. 1 

The design of module TM also accommodates adding an 
45 optional Camera Quality Monitor unit (CQM) 1-13. The 
CQM monitors normalized image data and normalize scaled 
image data from the NS boards, as well as compressed 
image data being sent from the HCs to the JCDB. Preferably, 
one CQM monitors data on the IM for the front image, the 
M other monitors data for the rear image. A variety of problems 
associated with the camera can be detected by analysis of the 
data collected at these points. As one example: when com- 
ponents in illumination system 1-3 age. lamp output may 
dim. Monitoring the normalized data and checking for a long 
55 term change in average document brightness, can allow one 
to notify service personnel that replacement or adjustment is 
required before the images are badly degraded. The front 
and rear images are each monitored by their own CQM. 

N/S Details 

60 

The Normalizcr/Scaler function is. as above noted, pref- 
erably implemented by a two board set (e.g.. see FIG. 1: 
Master 1-7 processing the four even-numbered channels 
from Digitizer 1-5; Slave 1-9 similarly processing the four 
65 odd-numbered channels therefrom). These boards 1-7. 1-9 
operate in synchronism, with one. the master, arbitrating. 
Master N/S Unit 1-7 also provides "document synchroniza- 
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tioiT signals (such as PDOCPRESJi) used by downstream require. Each H/C contains two image paths, and each path 

boards to identify that a document is being imaged. The NTS is capable of processing and compressing an entire image as 

pair also provide image data to the CAR unit. received from the master and slave NS boards. The JCDB's 

The N/S units employ a scan capture circuit to capture state machine determines that an image has arrived via the 

pre-normalized Image data for use in generating the numeric 5 PDOCPRES_N signal and selects the HC path to receive 

tables required to normalize the image data during normal we images from the master and slave NS; paths are assigned 

operation. Upon a command from the DTI, each N/S starts in a rotating sequence and according to the type of fault 

collecting pre-normalized image data; each channel has its detection required. The preferred configuration uses rotating 

own capture circuit capturing 16 consecutive scans of image redundancy to periodically verify HC operation; thus paths 

data (128 bytes of data per scan) into a first in first out to can be assigned in the following order: 0-1. 2. 3. 0. 1. 2-3. 

(FIFO) memory that can be read by the DTI board for 0, 1, 2. 3. 0-1 . . . etc. The HC boards contain logic that 

transfer again to the MP for processing. Data is collected as detects if the output data of the two paths does not match 

part of a calibration procedure in which the camera images (when they are both processing the same image); such a 

a uniformly white target and men a black target, to provide detection is an indication that a fault has occurred on one of 

"ideal" white and black stimuli to the camera. Software 15 the two paths. "Rotating redundancy" is useful for checking 

running on the MP executes an algorithm that transforms f Qr "hard failures**. If "transient failures** are of concern to 

this raw data into data tables suitable for normalizing image a particular application, then additional HC boards can be 

data. The data tables are transferred from the MP to the DTI added to the system and image data can be processed fully 

and then stored in "Look Up** tables on the N/S. redundantly. As a feature hereof, this HC unit allows com- 

The N/S normalizes incoming image data using the infor- 20 P^ 3011 of compressed images in their entirety (e.g.. vs 

mation in the look-up tables (preferably two 64Kx8 RAM. by-channels). 

one for test). Normalization is accomplished by using the A H C path receives the combined data from the master 

image data and its position in the scan to sequentially and slave NS boards and combines the odd and even channel 

address the look-up table. The content of each address has data into one image which is stored in a buffer memory (3-1. 

been precalculated by the normalization software running on 25 FIG. 3). As the data is being input to the memory, it is 

the MP from pre-normalized data (collected during sampled by a histogram width-detector 5-5. and a top and 

calibration) to be the normalized value of the image data for bottom edge detector 3-3. The histogram circuit 3-7 builds 

that pre-normalized value and position in the scan. There are a histogram of image data values composing the document 

128 possible output values for each of the 128 pixel posi- image. The histogram data is used to modify the image (as 

tions in the scan. 30 described later). The top and bottom edge detectors 3-3 

Scaling is preferably based on PROM look up tables; the sam P le ^ fmB ^ ^ 40(1 attempt to find the top and bottom 

tables allow the selection through software running on the of document me ^ hefeh* of the input 

MP of up to 8 "scaling factors**, (from a factor of "/w), to a ^ U scan )- 

factor of yw along with method of scaling. The preferred There are 1024 pixels in the preferred embodiment of the 
scaling is (%) using a 2x2 pixel window average method. IM scan; a typical 2.75 inch item will occupy only 550 pixels 
Document Edge Detection is performed with an algorithm of a scaD - Thc preferred algorithm looks for the highest and 
whereby each channel compares the average brightness of lowest occuirences of "non-background data** within all the 
"the present scan line with thc average brightness of me scans rf a document In the preferred ernrjodiment a "non- 
transport with no document present*. When no document is «, background" * declared if there is a gray level transition 
present, the detector averages and stores the average bright- within 5 pixels. The points determined for top and bottom, 
ness of the transport ("no document brightness-). Document a™* width, are made available to the Digital Signal Processor 
tracking logic in the document processor notifies these (DSP 3_15) uses thcm whcD document 
circuits that a document is about to enter, or leave, the range from the buffer. Finding the width (e.g.. lead and trail 
of the camera, and that comparisons should begin. If a 4 « edges) and the top and bottom of images allows the Digital 
significant change of brightness occurs in a channel, then (by Signal Processor 5-15 (DSP) to handle only genuine docu- 
this) that channel indicates that it has found an edge. meet data and ignore all else - - - thus improving throughput 
Leading edges are found when any one of the 8 detectors P^ovi^g images that do not have extraneous data 
finds that brightness has increased above the stored "no assodate<i with tncm - 

document average** by a preferred threshold of 14 gray 50 The software running on DSP 3-15 executes an algorithm 

levels, and PDOCPRES_N is asserted. Trailing edges are which uses the histogram data to alter the original image 

declared if all 8 channels have found that they have returned data i n the HC memory in a manner that reduces contrast and 

to within a preferred 18 gray levels of the "no document** stretches gray levels - - - thereby improving legibility and 

average; then PDOCPRES__N is cleared. If a leading edge compression characteristics (by means of the Remap 3-13). 

is expected and not found by any detectors after a prescribed 53 The HC compresses images in **two pass** fashion. The 

time, then "leading edge indication** is "forced** by asserting first pass preferably uses a JPEG Quantization Matrix (QM). 

PDOCPRES^N. This implies that the document image may The QM is a set of numeric factors used by the JPEG 

have problems, so this occurrence is flagged in "document algorithm to affect image compressibility and is known to 

status'*. The status data is transferred along with the nor- workers. The preferred (or target) QM is picked in the course 

malized and scaled (and later compressed) image data as it # of IM design to optimize both image quality and the size of 

moves through the system. the resulting compressed image packet The same QM is 



Details of Histogram Compressor. FIGS. 1-3 



used for first pass compression of all images. 
When "First compression*' is complete, the size of the 
The Histogram/Compressor functions are. as noted above. compressed image data packet is checked, along with image 
preferably performed in two like HC boards per side. 65 size. If the packet is too large (considering the size of thc 
Module FM accommodates up to 4 HC boards per side if image), an alternative QM is used for "second pass corn- 
height throughput or increased levels of fault detection so pression"; the alternative picked is determined from expe- 
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rieucc and is embodied in the algorithm executing on the 
DSP If the packet is smaller than expected, a less aggressive 
QM may be used; otherwise the target QM is reused. 

After second pass compression, the HC builds a standard 
JPEG compressed image structure in Output Buffer 3-25 and 5 
appends to it the status bits received from the NS 3-9. along 
with its own status bits and other information. 

When compression Is complete, data is queued in Output 
Buffer 3-25. and the JCDB is notified that the path-work is 
completed. The JCDB notifies the HC mat it is ready to 
receive the compressed data packet (and status) when it 
selects the HC for output. 

Thus, a typical such HC unit (e.g.. 1-llAfor bits 0. 1) may 
do the following: 15 

1 — Sample alternate pixels and assign one of 64 "bins' 1 ; 

2 — Locate image-top. -bottom 

3 — Measure image-length 

4 — Using its DSP (digital signal processor) histogram 
data, generate a "Remap Table" to reduce contrast and 20 
stretch grey level, and so make the bit image more 
legible and more compressible; 

5 — Initiate first compression; 

6 — Monitor results of First compression (and "status" 25 
from associated N/S unit) to build "header" in JCDB. 
And. if maximum allowed compressed size is 
exceeded, will accordingly translate images (from the 
bottom); and initiate a second compression if needed; 
and 30 

7— Prepare bit set for application to JCDB. 

JCDB 

Buffer JCDB 1-15 (FIG. 1) provides the interface between 
the HC paths and the MP 1-16. It preferably comprises a set 33 
(e.g.. 16x128 kilobyte) of compressed image buffer units, 
preferably operated as eight redundant buffer pairs 
(Primary-. Secondary-). The contents of the primary buffer 
is compared to the contents of the secondary buffer, upon ^ 
readout, as a method of validating hardware performance. 
These buffers are directly readable and writable by the MP 
via a local bus extension of the microprocessor of the MP. 
Should extra buffering capacity be needed. (e.g., the POL is 
busy), the JCDB can fall out of redundant operation and use 
its 8 secondary buffers to store images. When mis happens. 45 
the MP notifies the document processor to STOP document 
flow because there is a danger of running out of buffer space 
(which could necessitate a complex recovery procedure). 
The JCDB. as noted earlier, has a state machine which 
controls the selection of NS-to-HC paths for input of images 
from the NSs and the transfer of compressed image packets 
out of the HCs to the JCDB. Preferably, the MP can program 
the state machine on the JCDB to operate module IM with 
2. 3.or4HC boards. The JCDB also receives the Stop Flow 
Request lines from all boards. If any of these lines is 
activated the JCDB notifies the MP. Each of the NS. HC. or 
JCDB boards in module IM can have any of their detected 
fault conditions activated, by command from the MP. to 
trigger a "Stop Flow request" line to the JCDB. Results of 
this activation were discussed earlier. 
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Functions of JCDB 

(a) Controls selection of paths (input/output) to/from HC; 

Thus, can be programmed to operate with 2. 3 or 4 HC 65 
boards; also controls run-time testing of HC units by select- 
ing both of its paths to process image data. Also, monitors 



"busy" and "ready" signals from HC units to accommodate 
document throughput; 

(b) Verifies size of transferred image;(c) Provides "Sync 
Tag" data from a received image to DTI for verification; 

(d) Generates "interrupts" (e.g.. "STOP Flow"?) to MP 
and DTI upon receipt of image from HC array. 

Image Digitizer 1-5 

Image Digitizer ID 1-5. receives the output of the camera 
in the form of 8 pairs of analog signals (e.g.. 8-odd. fc-even 
pixels from 8-segment CCPD) plus a clock signal, and a 
"camera side" identification (front vs rear). The "side infor- 
mation" is determined at time of manufacture by installing 
a jumper. Preferably, this ID output comprises: eight chan- 
nels of serial, digitized video, with parity for each channel. 
The preferred clock rate is 8.125 MHz. with a 900 ns idle 
period between every scanltne (16.7 us). Digitizer ID also 
has a diagnostic memory that can be loaded with test 
patterns by the DTI over a special (C and D) bus. 

When the document processor tracking logic does not 
indicate any documents approaching the camera, the DTI 
senses this and commands a diagnostic RAM to inject test 
patterns into the eight channels. Identical data will be output 
on all 8 channels. These patterns are used by the NS to test 
normalization and scaling logic (by comparing data); they 
are also similarly used to test the interface between the ID 
and NS boards. The NS normalization circuit must alter its 
operation when test patterns are present on the channels to 
assure that the outputs of the multiple narmaiizer circuits are 
identical. The test portion of the narmaiizer look-up table is 
used to provide a 1 to 1 mapping when test patterns are 
activated, thus assuring that "data-in" matches "data-out". 

JPEG Compression Path Functions 

The Block diagram in FIG. 3 (as aforenoted) indicates the 
preferred functions performed along a single JPEG 
processmg/cornpression path on a preferred H/C PCB. Two 
independent JPEG processing/compression paths are imple- 
mented on each H/C PCB. These blocks are characterized 
briefly as follows: 

a— N/S Inputs 
The JPEG compression path receives "Normalized 
Scaled" (N/S) image data from the N/S hardware in 
two serial. 8-bit paths (see two N/S inputs, to 3-1. -3. 
-5. -7, -9). Each path contains 4 Channels of rime- 
multiplexed, scaled scans; scaled-down to a maxi- 
mum of 137.5 pixels per inch. The pixels are deliv- 
ered cross both paths at a rate of 50 ns per pixel (20 
MHz). Each pixel is 7 bits representing 128 grey 
levels with the MSB ("Most Significant Bit") of the 
8-bit path set to 0. 
b— Input Buffer. 3-1 
The entire scaled image is stored in a 1 Megxg Buffer 
3-1 as it is delivered from the N/S hardware, 
c— Top/Bottom Detect 3-3 
As the image is being received from the N/S hardware 
and stored in Input Buffer 3-1. the Top/Bottom 
Detect Circuitry 3-3 finds the Top and Bottom of the 
scaled image. The picture shown in FIG. 3 illustrates 
&n exaggerated skew condition that may occur 
(usually to a much smaller degree) as the sorter 
moves the check past the CCD camera. The Top/ 
Bottom Circuitry "finds** the extreme Top and Bot- 
tom locations. 
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d— Width Detect 3-5 

Lead-edge and Trail-edge detection is done by the N/S 
hardware. The Width Detect hardware (Stage 3-5) 
counts the number of scaled pixels scans between the 
extreme Lead and Trail edges as shown in FIG. 3. s 
e — Histogram, 3-7 

As the image is being received from the N/S hardware 
and stored in the Input Buffer, a Histogram Circuit 
3-7 samples every other pixel (one pixel every 50 ns, 
switching between both signals paths from the N/S 10 
hardware) and sorts the 128 grey level pixels into 
one of 64 Histogram Bins (LSB. or Least Significant 
Bit, of 7-bit pixel value is ignored). Once the image 
is entirely received, the final Histogram will have 
sorted 50% of the scaled image's pixels, selected in 15 
a checkerboard arrangement across the entire image, 
into the 64 bins that comprise the Histogram 3-7. 
Pixels above and below the detected Top and Bottom 
borders of the image are included in the Histogram, 
but pixels outside the detected Width are excluded. 20 
Each bin can record up to 64K occurrences of 
adjacent grey levels and will "peg" at 64K if that bin 
overflows, 
f— Status Block 3-9 

Status and other image-related information is appended 25 
to the Trailing Edge of the scaled image as it is 
delivered to the JPEG processing/compression path 
from the N/S hardware. This information is buffered 
in Status block 3-9 so that it can be retrieved and sent 
on with the compressed image. 30 
g — Transpose and Block Unit 3-11 

Hie N/S hardware delivers scaled image data in Ver- 
tical scans spanning 8 Channels and starting from 
either the Top or Bottom of the image (depending on 3J 
camera orientation), while moving vertically. JPEG 
compression requires image pixels to be compressed 
in 8x8. raster-scanned. Pixel Blocks. Pixel Blocks 
are then scanned in the same method as pixels within 
a block: horizontally across the Width of the image, 
and then vertically between the Top and the Bottom. 
This "Transposition and Blocking** Operation (3-11) 
can be started at any of the four corners of the image. 
Pixels outside the Top and Bottom borders of the 
image, and outside the Width of the image, are not 4J 
addressed during transposition — thus eliminating 
useless track background data from the Compressed 
Image Packet The output of the Transpose and 
Block Circuitry 3-11 serves as an address to the 1 
Megx8 Input Buffer 3-1. (See FIG. 6. also.) 
h— Remap Unit 3-13 

Image processing Is done by changing (Remapping at 
3-13) the 7-bit scaled pixels in the Input Buffer 3-1 
to 8-bit image-processed pixels as the image is being 
compressed. 33 
h— DSP Unit 3-15 

A DSP Unit 3-15 (Digital Signal Processor) determines 
the Remap Values by reading the 64-bin Histogram 
(from 3-7) along with inputs from 3-9. 3-5, 3-3), 
executing the image processing algorithms and load- go 
ing the 128 resultant "Remap Values" into a "1 to 1" 
Remap Memory at 3-13. 
j— LSI JPEG Compression. 3-17 

A DCT (Discrete Cosine Transform), quantization and 
Huffman coding for JPEG compression are done in 63 
a Chip Set (3-17, preferably from the LSI Logic 
Corporation). This Chip Set 3-17 does not need to be 



so 



* 'throttled" as it compresses an image, and. therefore, 
"compression latency" through this Chip Set is deter- 
ministic. Scaled, remapped pixels are sent through 
the LSI Chip Set 3-17 at a 25 MHz rate. The LSI 
output is a 32-bit word containing JPEG compressed 
data (but does not have bytes "stuffed" or restart 
codes inserted, these being inserted at Block 3-19). 
k — Packet Counter 3-21 
This Counter records the amount of compressed data 
emerging from the LSI JPEG Compression Chip Set 
3-17. This Count is used by the DSP Unit 3-15 to 
retrieve the results of first pass compression so a 
second QM can be selected for the second (final) 
compression. 
I— Post Processor 3-19 
The Post Processor performs the JPEG required byte 
stuffing and Restart Marker insertion not done by the 
LSI Chip Set The Post Processor funnels the 32-bit 
outputs from the LSI Chip Set down to a 16-bit wide 
Output Buffer 3-25. inserting stuffed bytes and 
restart codes when necessary. 
To ease the location of entropy-coded segments 
(compressed data between Restart Markers) in the 
final Compressed Image Packet restart codes are 
inserted on 32-bit boundaries by the Post Processor 
Unit 3-19 (codes recorded in 3-23). Therefore, the 
Post Processor must insert padding bytes, when 
required, to align restart codes on double-word 
boundaries, 
m— Restart Marker Table (FIFO) 3-23 
A table of addresses pointing to the location of Restart 
Markers in the Compressed Image Packet are stored 
in the Restart Marker FIFO 3-23 and can be used by 
the DSP 3-15 to truncate images on entropy coded 
segment boundaries. 
d — Output Buffer 3-25 
The JPEG processing/compression path assembles the 
Compressed Image Packet in a 64Kxl6 Output 
Buffer 3-25. Once a Compressed Image Packet is 
completely assembled, it can be burst-transferred to 
the JCDB next component (JPEG Compressed Data 
Buffer) in the imaging system. 
In sum. the DSP 3-15 performs the following functions: 

i — After an image is input from the N/S. the DSP 3-15 
reads the 64-bin Histogram, executes the image pro- 
cessing algorithms and loads the resultant Remap Table 
into the Remap RAM (at 3-13); 

ii — Prior to first pass compression, the DSP loads the 
default QM and Huffman tables into the LSI JPEG 
Compression hardware; 

iii— After first pass compression, the DSP retrieves the 
results (of first pass compression) from the Packet 
Count Register 3-21. and the image dimensions from 
the Top/Bottom and Width Detectors, then selects a 
new (second) QM and Huffman table to achieve the 
proper compression results for a second compression, 
and loads this chosen QM and Huffman table into the 
LSI Chip Set; 

iv — After second pass compression is complete, the DSP 
inserts all pertinent header information into the Com- 
pressed Image Packet in Output Buffer 3-25. 

JPEG Processing/Compression Functions 
Implemented in Hardware 

In the previous section, the functions of the JPEG 
processing/compression path were introduced. In this 
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section, the hardware-intensive functions are described in 
detail. The DSP functions, although critical to operation of 
the JPEG processing/compression path, are software based 
and not discussed in this section. The hardware functions 
next detailed are as follows, then detailed: 
Histogram 

Top/Bottom Detection 
Width Detection 
Status Capture 

Transpose and Block - Input Buffer 
Remap 

LSI JPEG Compression 
JPEG Post Processor 
Restart Marker FIFO 
Packet Count 
Output Buffer 

The DSP. via software, executes the "grey level stretch 
and contrast reduction" algorithms by reading the 64 bin 
histogram of an image and generating a 128-entry remap 
table to be used by the Remap hardware. Also, the DSP 
chooses and loads the LSI chips set with the QMs and 
Huffman tables needed for first and second pass compres- 
sion. Lastly, the DSP builds the necessary header data, 
(surrounding die compressed image data), and loads this 
header data into the Output Buffer 3-25. 

Histogram 

The Histogram is generated in unit 3-7 as the image is 
being delivered from the N/S hardware and stored in the 
Input Buffer 3-1. The Histogram could have been generated 
without any custom hardware by having the DSP unit scan 
die contents of the Input Buffer after the image has been 
loaded. This, however, would greatly increase the time 
required for the JPEG processmg/comprcssion path to pro- 
cess the image because: 

1 — Not only would it take relatively long (compared to 
custom hardware) for the DSP to subsample the con- 
tents of the Input Buffer, but 

2 — this sampling could not be done until AFTER the 
image was stared in the Input Buffer. 

Thus, by generating a Histogram with custom hardware 
WHILE the image is being input the Histogram is available 
to the DSP as soon as the image has been input 

The only apparent drawback to so generating the Histo- 
gram during input of the image is that the Histogram is being 
generated BEFORE the Top and Bottom boundaries of the 
check image have been determined (lead and trail edges of 
image are predetermined by N/S hardware). This means that 
pixels representing track background, above the top and 
below the bottom borders of the check image, are included 
in the Histogram, This will cause the "darkest" bins of the 
Histogram to be fuller than if the boundaries were known 
prior to generating a Histogram. This apparent drawback, in 
reality, is inconsequential, since the image processing 
algorithms, selected performed by the DSP according 
hereto, are not significantly affected by the quantity of pixels 
in the "darkest" bins. 

The Histogram circuitry samples 50% of the pixels in the 
image by sampling pixels every 50 ns (20 MHz input from 
N/S) from one of the two serial N/S inputs (Channels 0. 2. 
4. and 6) and then from the other (Channels 1. 3. 5. and 7). 
The net effect is that the pixels sampled are arranged in a 
checkerboard pattern across the image. As a pixel is 
sampled, the "upper 6 bits" of the 7-bit pixel (LSB is 
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ignored) arc used to address a 64-bin Histogram RAM. The 
contents of the RAM at the addressed location are extracted, 
incremented by 1 and reloaded into the RAM. These itera- 
tions of reading, incrementing and writing must be done 

5 every 50 ns. Although a 20 MHz synchronous clock is used 
to begin every iteration, the reading, incrementing and 
writing are performed with asynchronous, pipelined logic 
using 2 CPLDs (Complex Programmable Logic Device) and 
2 SRAMs (Static Random Access Memory). 

to Each of the 64 bins is 16-bits wide and can therefore 
record 64K occurrences of adjacent grey levels (e.g.. 100 
0101 and 100 0100 are sorted into bin 33). If. during the 
'Read-hcrement- Write" iterations, any of the bins become 
full (reach a count of OxFFFF). this bin will NOT overflow 

15 with any additional pixels (reset to 0x0000) because the bin 
will peg at OxFFFF. This is essential for the image process- 
ing algorithms to get a good approximation of the grey level 
content and distribution in the image. 

20 Transpose and Block Input Buffer 

The Input Buffer 3-1 is used to store the contents of the 
scaled, normalized image so that it can be transposed, 
grouped into 8x8 pixel blocks and sent to the compression 
hardware. Not only is it necessary to store the entire image 

25 for transposition purposes, but it Is essential, to achieve 
predictable compression results, to perform 'two-pass com- 
pression*' on a fixed input image. 
The Transpose and Block function (see 3-11) is used to 

M generate the 20-bit address needed to access the 1 Megx8 
Input Buffer. It is this function that first stores the image data 
into the Input Buffer 3-1 as it is delivered from the N/S. and 
then removes the data in transposed. 8x8 blocks during each 
of the two compression passes. 

35 To understand how this is done, it is important to know 
how the 1 Megx8 Input Buffer 3-1 is spatially divided. This 
arrangement is shown in FIGS. 5. 6. Since the Input Buffo- 
is byte-wide, each byte will hold one 7-bit pixel (MSB is 0). 
The 1 Megx8 buffer is first divided into eight horizontal 

40 128Kx8 Channel Buffers representing the 8 channels of 
image data from the N/S (e.g.. see FIGS. 5. 6A). The 3 
MSBs of the 20 address lines access one of the 8 channels. 

Each 128Kx8 Channel Buffer is divided into an 186x11 
array (FIG. «B) of 64-pixel blocks. The reason for this 

45 arrangement will be explained later. Eleven of the 20 address 
bits are used to select the block within the Channel Buffer. 
Finally, each block is divided into an 8x8 array of pixels 
with the 6 LSBs of the 20 address bits used to select the pixel 
within a block (FIG. 6C). 

50 The Channel Buffers are arranged in an array of blocks 
composed of 11 horizontal rows by 186 vertical columns. 
Because the maximum scaling resolution acceptable by the 
JPEG processing/compression hardware is 137.5 dpi 
Cloths scaling of 200 dpi captured image), the maximum 

55 number of pixels processed, per vertical scan in one channel, 
is 88. Since there are 8 rows of pixels per block. 11 blocks 
are needed to cover the vertical dimension (FIG. 6B). One 
vertical column of 11 blocks consumes 704 ( 11 x64) memory 
locations. Since there are 131072 (128K) locations in each 

60 Channel Buffer, up to 186 (131072/704=186.18) columns of 
11 blocks can fit inside the memory. At 137.5 dpi (Widths 
scaling), this translates into a horizontal measure of 10.8 
inches . . . more than enough to store the maximum check 
width of 9 inches. It is rare that some of the columns on the 

65 'far left" (see FIG. 5) of the Channel Buffer would ever be 
used, since the average check length would be between 6 
and 7 inches. Likewise, if scale factors less than 137.5 dpi 



03/18/2004, EAST Version: 1.4.1 



5J68 ; 446 



17 

( n /«5ths scaling) are used, the block rows near the top of the 
Channel Buffer will not To access the Input Buffer. (3-1. 
FIG. 3). the hardware implements five counters listed below 
(and shown in FIG. 6D): 



Cbimiel Counter 


3 bits 


Accesses the 8 horizontal 
Chara**! Puff or that 
comprise die Input Buffer 


Horizons] Block Counter 


8 bits 


Accesses die U rows of 
blocks in each Channel 
Buffer 


Vertical Bkxk Counter 


4 bits 


Accesses the 186 columns 
of blocks in each Channel 
Buffer 


Column Counter 


3 bits 


Accesses the 8 columns of 
pixels m each 8x8 block 


Row Counter 


3 bits 


Accesses the 8 horizontal 
rows of pixels in each 8x8 
bkxk 
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Because the Vertical Block Counter and Horizontal Block ^ 
Counter are not rally utilized (11 of 16 and 186 of 256 
respectively), their combined values are remapped, via a 
"PROM look up table", to form a Block pointer value 
consisting of 11 bits. In total therefore. 20 bits are needed 
to access the entire Input Buffer 3-1 (FIGS. 3. <SD). M 

By controlling the five counters described above (FIG. 
6D) and changing their operating parameters (when they are 
incremented, when they are reset or preset and whether they 
count up or down), the hardware is able to store a vertically 
scanned image in the Input Buffer 3-1 and then unload, in 30 
8xg blocks, starting from either of the four comas of the 
image. 

The following describes detailed control of the five 
counters during image capture and image compression. 
Counter Control During Image Capture 35 
During image capture, the NTS hardware delivers vertical 
scans of pixel data in two serial pixel streams as shown in 
FIG. 2. 

To store ONE vertical scan, the JPEG processing/ 
compression hardware must store these pixel pairs at two 
separate locations in its 1 Mcgx8 Input Buffer (FIG. 5) 
simultaneously. For this reason, the least significant bit of 
the Channel Counter is not used during image capture 
because pixels are received in pairs (from channel (VI. 2/3. 
4/5 and 677 respectively) and must be stored in two separate 45 
channels of the Input Buffer simultaneously. As valid pixel 
pairs are delivered from the N/S hardware, the Row Counter 
(FIG. 6D) is incremented When the Row Counterfoils over 
(every 8 pixels), the Vertical Block Counter is incremented 
When the Vertical Block Counter reaches the scale factor 
(e.g.. when the Vertical Block Counter reaches U for ^idhs 
scaling), the Vertical Block Counter is reset and the Channel 
Counter is incremented by 2. When the Channel Counter 
rolls over from 6 to 0. the Column Counter is incremented 
In this fashion one vertical scan is stored in the Input Buffer 55 
(3-D. 

Every 8 scans, the Column Counter will roll over and the 
Horizontal Block Counter is incremented Once the image is 
completely input the Horizontal Block Counter will Indicate ^ 
the width of the scaled image in units of 8 pixel blocks. 

Counter Control During Compression 

To understand the control of the counters during 
compression* use FIG. 5 for reference. In this figure, an 
image has been stored in the Input Buffer during image 65 
capture. The valid portion of the image lies between Hori- 
zontal Block (HBLK) #0 and HBLK #120 (as determined by 
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the width count) and between channel 5. Vertical Block 
(VBLK) #1 and channel 0, VBLK #9. In this example, 
compression will begin at top left corner of the image and 
will proceed left to right top to bottom. Compression 
direction can begin in any of the 4 corners of the captured 
image and counter control will be slightly different for each 
compression orientation. 

To start the Channel Counter is preset to 5. the VBLK 
counter is preset to 1. the HBLK counter is preset to 120. the 
Column Counter is preset to 7 and the Row Counter is preset 
to 7 (upper left-hand corner of image). For JPEG 
compression, pixels must be raster scanned one pixel at a 
time, one block (64 pixels in 8x8 array) at a time. If the 
image is being compressed left to right top to bottom (as it 
is in this example), all 64 pixels within the block must be 
read in the same direction before another block is read 
Therefore, to read one 8x8 block, the Column Counter is 
continuously decremented (from 7 to 0) and every time the 
Column Counter rolls over (7 to 0) the Row Counter is 
decremented Once the entire block has been read (64 
pixels), the HBLK counter is decremented (moving left to 
right) and 64 pixels are read from the next block. After all 
120 blocks are read in a row (HBLK counter reaches 0). the 
VBLK counter is decremented (moving top to bottom), and 
the HBLK counter is preset to the image width (left side or 
120 in this example). Once the VBLK. HBLK. Column and 
Row counters reach 0 (bottom right comer of a channel), the 
Channel Counter is decremented the VBLK counter is 
preset with one less than the scale factor (top of the channel 
or 10 in the case of Widths scaling), the HBLK counter is 
preset to the width (left or 120 in this example) and the 
Column and Row counters are preset to 7 (top right corner 
of a block). Counter control proceeds until the pixel at the 
bottom right corner of the image is read (in this example 
CH=0, VBLK=9. HBLK-0. Column=0, Row=0); then com- 
pression terminates. 

Top/Bottom Detection (e.g., see 3-3, FIGS. 3,7) 

The top and bottom borders off an image are detected as 
the image is being delivered from the N/S hardware and 
stored in the Input Buffer 3-1. 

The borders could have been found without any custom 
hardware by having the DSP scan the contents of the Input 
Buffer after the image has been loaded This, however, 
would greatly increase the time required for the JPEG 
processmg/cornpression path to process the image (e.g.. not 
only would it take relatively long for the DSP to sample the 
contents of the Input Buffer, but this sampling could not be 
done till AFTER the image was stored in the Input Buffer). 
By finding the borders with custom hardware WHILE the 
image is being input the borders are available to the DSP as 
soon as the image has been input — thus saving time. 

The top and bottom borders detected by the hardware are 
relative to the scan direction of data received from the N/S 
hardware. In other words, scans are assumed to be "pixel- 
wide" vertical strips spanning all 8 channels starting at the 
bottom block of channel 0 and proceeding to the top block 
of channel 7. The bottom border of the image is the lowest 
occurrence of image data relative to the scan direction. This 
may actually be the top of the physical image, depending on 
which camera is capturing the image (front or back) and how 
the check was loaded in the track (e.g. upside down?) 

The resolution of the border detection circuitry is in units 
of blocks, not pixels. Therefore, borders are reported accord- 
ing to the channel and block row within the channel. A 
typical example of bottom and top borders detected by the 
hardware are BOTTOM=channel 0, row 6; TOP=channel 6. 
row 3. 
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Borders arc determined on a "scan-by- scan* basis. 
Initially, prior to receiving the lint vertical scan of an image, 
the top border is set at toe extreme BOTTOM (CH 0, block 
0) and the bottom is set at the extreme top (CH 7. block A). 
As the first scan is delivered from the N/S. the JPEG 
compression path hardware compares each pixel to a given 
i€ border" threshold value. Pixels 'Vhiter** than the threshold 
are considered part of the check image, while pixels 
"darker* than the threshold are considered track back- 
ground. Every time 5 consecutive image pixels are seen, the 
hardware declares a 'transition". The first transition seen in 
a scan is considered the "bottom** of that scan while the last 
transition in a scan is considered to be the 'top**. After each 
scan, the top and bottom borders of the latest scan are sent 
to a Top and Bottom Port Only if the latest scan* s top border 
is "higher** than the value presently existing in the Top port 
will the Top port be updated to the new value. Likewise, only 
if the latest scan's bottom border is "lower" than the value 
presently existing in the Bottom port will the Bottom port be 
updated. The net result is that, after the entire image has been 
input, the Top port will contain the channel and block 
number of the "highest" point of the image and the Bottom 
port will contain the channel and block number of the 
"lowest** point of the image. 

The reason the hardware requires five (5) CONSECU- 
TIVE image pixels before declaring a transition is to prevent 
the top/bottom circuitry from erroneously declaring a border 
based on dust or scrap (noise) in the track that might exceed 
the value of the selected threshold for a few consecutive 
pixels. Selection of five has been determined experimentally. 

Although, this concept of border detection may seem 
straight-forward, it is complicated by the fact that the 
vertical scans are not delivered to the H/C by a single pixel 
stream sequentially from the bottom to the top of the scan. 
Rather, data is delivered simultaneously from two pixel 
streams representing data from odd/even channels (0. 2, 4 
and 6 and channels 1, 3, 5 and 7). respectively. To find a 
border of a single scan based on two interleaved streams of 
pixels, the hardware implements two independent transition 
detectors TD-1, TD-2 (one for each N/S pixel stream; see 
FIG. 7; FIG. 7 illustrates top/bottom detection from two 
serial pixel streams). When transitions are detected, the 
hardware considers which of the two detectors found the 
transition, the value of the Channel Counter and the value of 
the Vertical Block Counter (see the Transpose and Block 
description) to see where, in the scan, toe transition took 
place. Based on this information, the appropriate Top or 
Bottom port can be updated. 

Width Detection 

The top and bottom borders arc detected by the JPEG 
processing/compression path hardware, but the right 
(leading) edge and left (trailing) edge are detected upstream 
by the N/S hardware. The N/S hardware, subsequently, only 
"qualifies** the data between the lead and trail edges when it 
delivers pixel data to the JPEG processing/compression 
(P/C) paths. The N/S hardware will only qualify data in 
groups of 8 vertical scans. In other words, the N/S hardware 
frames toe image in toe horizontal dimension on block 
boundaries. Therefore, the only action the JPEG processing/ 
compression hardware need perform to detect the width of 
the image (in block units) is to count every eighth qualified 
scan from the N/S unit By doing this, the JPEG processing/ 
compression hardware is able to furnish the horizontal 
dimension of the image to the DSP as soon as the image is 
input from the N/S. 

Status Capture 

When the N/S hardware sends image data to the JPEG P/C 
path, it appends a burst of image-related "status** informa- 
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uon on the "back porch** of the image transfer. The JPEG 
P/C path must take this information, supplement it with 
"status data** pertinent to toe P/C hardware and attach it to 
the now Compressed Image Packet that is to be sent to toe 
5 rest of the check imaging system via the JCDB (output of 
FIG. 3). 

The JPEG P/C hardware accomplishes this function by 
buffering the "status data* 1 as it is received from the N/S 
(buffered at 3-9 FIG. 3). and then making this data available 
10 to toe DSP for inclusion in the final Compressed Image 
Packet 

Remap (See 3 13. FIG. 3) 

The normalized and scaled image received from the N/S 
15 unit, and stored in Input Buffer 3-1 (FIG. 3). is processed 
prior to compression. As stated earlier, the image processing 
algorithms are executed by the DSP. based on the image 
dimensions and histogram generated by the hardware as the 
image was being input from the N/S. Once the algorithms 
20 are executed, the image could be updated by having the DSP 
update every pixel in the Input Buffer to its new image 
processed value. Such a method would take a relatively long 
time, since the DSP would have to fetch, update and write 
every pixel in the Input Buffer. 

A much faster method is preferred: i.e.. to remap pixels 
"on the fly** as they are sequentially sent to the compression 
hardware. To implement this method, the DSP generates a 
128-entry "remap table** (one for every pixel grey level). 
During compression, every pixel (7 bits) pulled from toe 
Input Buffer addresses the 128 entry table (implemented in 
high speed RAM at 3-13) and the output from tbe tabic is the 
remapped, image processed value (8 bits) for that pixel. This 
'remapped pixel** (value) is then sent to the compression 
35 hardware (i.e.. to 3-17. and beyond). 

LSI JPEG Compression (see 3-17, FIG. 3) 

The JPEG defined Discrete Cosine Transform (DCT). 
quantization and H uffman coding is implemented in a two- 

40 chip set from LSI LOGIC CORPORATION. This chip set 
requires that image pixels be delivered in 8x8 blocks. The 
retrieval of image data from Input Buffer 3-1 in the proper 
(8x8) sequence is effected by the Transpose and Block logic 
3-11. The pixels are remapped (image processed) "on the 

45 fly** (at unit 3-13) before being sent to toe LSI chip set (i.e. 
to block 3-17). 

Because of the performance requirements of the high 
speed check imaging system, it is important to be able to 
compress the video image in Input Buffer 3-1 to a known 

50 packet size in a determinate amount of time. The image will 
be compressed once with the LSI chip set. using a standard 
QM and Huffman table provided by the DSP. Then, the 
result of this first compression, along with the image 
dimensions, will be used by the DSP to select a second QM 

55 and Huffman table which is then sent to the LSI chip set by 
the DSP. With this second QM and Huffman Table, this 
image (bit set) is then compressed a second time, then 
passed through Post Process unit 3-19 and stored in Output 
Buffer 3-25. This "dual compression** technique is a feature 

60 hereof, and will be understood to yield tbe desired compres- 
sion packet size. 

The design of the chip set by LSI LOGIC Corp. is such 
that the time required to compress an image can be deter- 
mined by toe amount of pixels to be compressed, as well as 

65 by the speed at which compression is executed. Even in the 
(statistically rare) case where JPEG compression results in 
EXPANSION, the LSI JPEG chip set will take no longer to 
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execute. This feature is critical to performance in a high compression is more predictable), the probability of "busy** 

speed check imaging system like the indicated DPI 800. To portions of image occurring is greatly reduced. Therefore, 

further increase compression speed and reduce the time a any FIFO buffer, let alone a IK FIFO, would rarely be used. 

JPEG compression path requires to process an image, the In the statistically-rare case where the FIFO (5-17 A) is being 

operating clock frequency of the JPEG compression path is 5 heavily used, the input to the LSI chip set will be throttled 

preferably increased from 20 MHz to 25 MHz during by the JPEG compression hardware when the FIFO (3- 17 A) 

compression. reaches "half-fulT (512 words waiting for Post processing). 

Although this feature will rarely be used, it prevents data 

Packet Count (see 3-21. FIG. 3) from being lost even in the most extreme case. In fact. 

^ , . tn images would have to EXPAND by a factor of 4 before this 

TTieJFEGP/Charc^areneednotsavemeresuUsof^st » feature would ever kick-in. The only side effect of executing 

pass compression . Therefore, many of the functions ^ feature is a slight mcrcasc m compression time due to 

executed by Post Processor Unit 3-19 (e.g., byte stuffing. ^ occasional 'throttling" of the input to the LSI chip set (in 

restart code insertion, writing to Output Buffer) are not done 3_i7), 
during "first pass compression'*. What is needed from first 

pass compression is merely an estimate of the result it yields. 1 5 Restart Marker FIFO (3-23. FIG. 3) 

lb provide this, the (32-bit) words output from the LSI During "second pass compression**, the JPEG P/C hard- 

LOGIC chip set 3-17 during compression are counted by the ware generates and loads the compressed (entropy-coded) 

Packet Counter 3-21. The only inaccuracy in this count is data into Output Buffer 3-25. After second pass compression 

that it does not include any "extra data" like stuffed bytes. is complete, the DSP builds the required header information 

restart codes or padded bytes that would be added to the 20 around the entropy coded data packet. One of the required 

compressed image by the Post Processor 3-19 (sec FIG. 3). elements of the header is a table of offsets that will point to 

This extra data, however, is relatively insignificant, even for the END of each entropy coded segment in the Output 

the most compressible images. Buffer. An entropy coded segment from the JPEG P/C 

After "first pass compression**, the DSP reads the Packet hardware is comprised of the compressed data from one 

Counter and uses this "word-count** information to pick a 25 horizontal row of 8x8 blocks, ending with a restart marker. 

Huffman Table and a QM for the "second compression" Providing this table allows the compressed image to be 

"gracefully" truncated by software on entropy coded seg- 

JPEG Post Processor (See 3-19 and 3-17A FIG. 3) ment boundaries. 

The LSI JPEG chip set outputs 32-bit words of "entropy M The DSP 8 ets "offset" information from the Restart 

coded data" during compression. This data does not include Marker FIFO 3-23. During second pass compression, the 

the JPEG required "stuffed bytes" (a byte of 0x00 must Post Processor 3-19 must insert restart markers into the 

follow every byte of OxFF entropy coded data), or the JPEG Output Buffer at the end of each entropy coded segment 

required Restart codes** (two bytes of OxFF and OxDy after Whcn mc Post Processor loads a restart marker into the 

each horizontal row of blocks has been compressed) or the 35 Output Buffer, the address into the Output Buffer at that 

4, padding bytes" (OxFF) required by the application to align particular instant is loaded into the Restart Marker FIFO, 

restart codes on 32-bit boundaries. Output Buffer (3-25. FIG. 3) 

The JPEG compression hardware must take the 32-bit 64KX16 Output Buffer 3-25 is the physical location 

output from the LSI chip set. insert the necessary data where me Compressed Image Packet is built by the JPEG 

described above and funnel this information down into the 40 compression hardware (entropy coded data) and by the DSP 

^it-wick ^Output Buffer 3^25. To accomplish this the (hcadCT information). During second pass compression the 

^ G ^ $t T ^ SSOr 3-1 ' ° DC b Vff a ^ h ° m entropy coded data is loaded into the Output Buffer. After 

£™ 3^.^ ***bytc equals sccond pass compression is complete, the DSP builds the 

OxFF, send this o^o the Output Buffer - - - and also send rcmainiog information around the entropy coded 

an<>therbyteofOxTOtfto data. Once this is complete, the Image Packet is ready for 

compressing each horizontal row of blocks, the Post Pro- to ^ next stage (see j CD B, or "JPEG compressed 

cessor will insert the two-byte restart marker and the number Da ta Buffer. FIG. 3) of the high speed check imagine 

ofjpadding bytes requiredto align restart markers on 32-bit system; and then the JPEG compression path is free to 

boundaries. JPEG standards require the restart marker to accept another image into its Input Buffer 3*1. 

have aMOD 8 count component; and this is provided by the 50 ^ > Mual buffering** (Input Buffer and Output Buffer) so 

Post Processor hardware. , . . . moJC . . n~ 7 . 

_ implemented in my JPEG prrcessing/compression path 

On average, it takes one clock cycle for the Post Processor acc0 rding to this feature, enhances performance by allowing 

to process each byte of data from the 32-bit (4 byte) LSI chip a sccond t0 ^ ^rived by a JPEG compression path 

set . two clock cycles if a 0x00 byte needs to be stuffed brf^ th c ^ Compressed Image Packet is seat to the 

While compressing "busy portions of the image, it is 53 jcdb. 
possible (worst case) for the LSI chip set to output a 32-bit 

word 3 times for every four docks. The Post Processor Reprise 

cannot keep pace with the LSI chip set during these "busy" In summary, it will be understood that this invention 
portions of the image. To mitigate such "special provides, among other features, a digital data processing/ 
circumstances**, the JPEG compression hardware preferably 60 compression arrangement, especially for video (image) data 
also provides a 1Kx32 FIFO buffer 3- 17 A between the LSI bits representing a documents-presented in serial stream- 
chip set output and the Post Processor Logic (i.e.. between especially using a pre-processing buffer stage for presenting 
5-17 and 3-19). This buffer 3-17A allows the LSI output data the data in two parallel bit-streams, with two parallel like 
to be buffered, and not lost, while the Post Processor catches compression paths, especially where 'two-stage** corapres- 
up during "un-busy** portions of the image. Since the Post 65 sion is used, doing so in *Teal time" and. preferably to JPEG 

Processor only operates during "second pass compression** standards more especially using a single two-pass PC 

(when the DSP has already selected a target QM. and when board. 
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While the above describes how to make and use certain 
invention embodiments, various alternative constructions 
and techniques may be employed without departing from the 
true spirit and scope of the invention as here claimed 

Workers will appreciate how aptly such a dual, two-path. 5 
two-stage compression arrangement is more effective for 
real-time processing. 

It will be understood that the preferred embodiments 
described herein are only exemplary, and that the invention 
is capable of many modifications and variations in 10 
construction, arrangement and use without departing from 
the spirit of this invention. 

Further modifications of the invention are also possible. 
For example, the means and methods disclosed herein are 15 
also applicable for compressing other serial bit-sets. 

The above examples of possible variations of the present 
invention are merely illustrative. While variations in these 
various embodiments may not. each, yield all the mentioned 
advantages, certain features may loom more important than 20 
others depending on the application. Accordingly, this 
invention is to be considered as including all possible 
modifications and variations coming within the scope of the 
appended claims, and to be limited only by these claims. 

What is claimed is: 25 

1. In a system for processing and imaging documents to 
develop a stream of digital, video bit sets, each related to a 
different document in a passing array, mis system including 
an arrangement for simultaneously compressing a number of 
said bit-sets for different document images and sending the 30 
results to output means, this arrangement also comprising: 

edge-detect means for combinatorially determining the 
top and bottom location of document images, plus the 
width thereof; 

a preprocessing stage for distributing each said bit set in 35 
a pair of like parallel bil-compression paths, one. a 
Master path for half the bits in a set the other a Slave 
path for the other half of the bits in a set. as controlled 
by said Master all input to a common buffer means, 
each said compression path being adapted to execute a 40 
prescribed first compression and then a prescribed 
conditional second compression when prescribed initial 
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factors are indicated and provide a prescribed real- 
tirae-compressed output to said buffer means; 
both said compressions being performed on a single 
two-pass stage of a Histogram/Compressor printed 
circuit board. 

2. A system for processing and imaging items to develop 
a stream of digital, video bit sets, each related to a different 
item in a passing array, this system including an arrangement 
for simultaneously compressing a number of said bit-sets for 
different document images and sending the results to output 
means, this arrangement also comprising: 

a preprocessing stage for distributing each said bit set in 
a pair of like parallel bit-compression paths, one. a 
Master compression path for half the bits in a set. the 
other a Slave compression path for the other half of the 
bits in a set. as controlled by said Master all input to a 
common buffer means, each said compression path 
being adapted to execute a prescribed first compression 
and then a prescribed conditional second compression 
when prescribed initial factors are indicated and pro- 
vide a prescribed real-time^compressed output to said 
buffer means, 

3. A system for processing and imaging checks and like 
documents to develop a stream of digital, video bit sets, each 
set related to a different item in a passing array, this system 
including an arrangement for simultaneously compressing a 
number of said bit-sets for different document images and 
sending the results to output means, this arrangement also 
comprising: 

a preprocessing stage for distributing each said bit set in 
a pair of like parallel bit-compression paths, one. a 
Master compression path for half the bits in a set. the 
other a Slave compression path for the other half of the 
bits in a set. as controlled by said Master all input to a 
cornmon buffer means, each said compression path 
being adapted to execute a prescribed first compression 
and then a prescribed conditional second compression, 
but only when prescribed initial factors are indicated, to 
this provide a prescribed real-time compressed output 
to said buffer means; and thence to said output means. 

* * * * * 
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